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ABSTRACT 


This study examines a differential game Surveillance- 
evasion model in an effort to evaluate an existing model, 
bridge the gap between theory and applications of the 
theory and to attempt to provide insight into further 
extension of theory. 

Escape paths generated by the model were plotted for 
the case where surveillance could not be maintained. Short- 
Pomangs Of the model, most notably the lack of provision 
for the reacquisition of the Evader after escape, were 
discussed and suggestions for future models to accomplish 


mnas were made. 
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This report documents 
a differential game model 
ation as related to Naval 
waS paid to the aspect of 


meecally depict the proper 


INTRODUCTION 


the results of an examination of 
of a surveillance-evasicn sien 
Warfare. Particular attention 
adequacy of the model to realis- 


operational situation and to 


the applicability of the model to the operational require- 


ments currently required to be met by the Naval forces at 


Sea. 


The particular model which was the subject of this 


evaluation was one used by J. Taylor [l]. This work was 


undertaken in an effort to bridge the gap between pure 


theory and application and to provide insight into possible 


Future extensions of theory. 








Die DESCRIP Or MODE I 


The model presented in [1] 1S Summarized here for 


convenience of discussion. 


me OLALTEMENT OF THE PROBLEM = 

A tracker, or pursuer, attempts to maintain surveillance 
ever another object, or the evader. The Pursuer has a speed 
advantage over the Evader, but the Evader 1S more manueverable 
mopchiat the Pursuer is restricted in his turning radius, or 
rate of change of direction, while the Evader is permitted 
to change his direction of movement instantaneously. The 
Pursuer 1S considered to have a "cookie cutter" detection 
device; that is, Surveillance is maintained only as long as 
the distance from the Pursuer to the Evader is less than 
the detection range of the device. 

The objective of the Pursuer is to maintain the Evader 
under surveillance as long as possible and conversely the 
Evader attempts to escape the Pursuer's detection region as 
quickly as possible. 


The following notation is repeated from [1]: 


aa Pursuer's speed with maximum Wy 

Sy = Evader's speed with maximum Wo 

R = Pursuer's minimum turning radius 

fo) = Fraction of maximum course curvature employed 
Dy PULSUC hr MOw—— Pecorrescponcs. to 1.eitearurm 


with minimum turning radius) 








<= 
II 


Evader's heading relative to that of Pursuer 


d = Pursuer's detection range 


Ea 
II 


time for Evader to escape (reach circle of 
radius d from Pursuer) 


This study was conducted from the point of view of the 
Pursuer. Therefore the problem is (from [1]) 
Ah 


max min | Gig 
0 


subject to the equations of motion of the Pursuer and the 
Evader. In solving this problem it is customary to use.a 
relative coordinate system wherein the Pursuer is always at 


the origin with a heading in the positive direction along 








the verticle axis. In this way the problem becomes (from 
[1]}) 
Ab 
max min | dt with T unspecified, 
0 
91S) WrSo 
S,y¢ 
, dete | all ; 
Soe eat Or ae R 1° S5siny 
S,xo 
aye i = 
dt ee oe eae 
ONCE el SS) 3S Saale 
O< Sy < Wi 
0 £ 85 S05 < Wy, 


With Gipgtial Wocation of Evader 


See — 0) Xor 


Vite = 0) = LEG) ts 








and terminal surface defined by 


x7(T) + y7(T) = a’. 


For the derivation of these equations the reader is 
referred to Appendix A of [1]. 

It is assummed that the situation of perfect information 
exists; that 1s, each participant knows the actions of the 


other instantaneously. 


Eee OPTIMAL ESCAPE TRAJECTORIES OF THE EVADER 
The optimal escape trajectory of the Evader as derived 


PaAppendix D of [I] is given by 


val R na 
(1) = (dee tw,)sin(u + not) + g (i- cOSp-$T), (1) 
and 
co ae ae 
at) =e tw.) cos (u + pot) + eee (2) 
mena 
U <u <5 


where 
W 
1 
O2U=s5, 


and f= (fT — €) . 








U denotes the angle between the heading of the Pursuer 
and the point of escape from the detection region by the 


Evader. 








ELL. DISCUSSTONSOr LHe. MODE 


Escape trajectories for the case where the model indicated 
that surveillance could not be maintained were plotted for 
angles of escape from the detection region of 60 degrees 
through 180 degrees at 10 degree intervals. The solutions to 
equations (1) and (2) for value of tT greater than zero 
established these paths as shown in Figure ]l. The values of 


the parameters used in all computations in this report were: 


R = 20 
d = 107 
Wy = 20 
a 10 


A. OPTIMAL ESCAPE PATHS 

From Figure 1 it can be seen that escape paths exist for 
all points in the state space and the "Surveillance pockets" 
which Taylor [1] suspected are not present. Also, the paths 
for escape at points between 60 degrees and 90 degrees are 
smooth and continuous. 

It should be noted, however, that although all points 
on a given curve satisfy equations (1) and (2), only that 
portion of the curve in the first quadrant of the detection 
region iS optimal. 

For the curve BB'B", for example, the value of T in (1) 


and (2) which give the point B' is 1.2. However, if at that 


10 








point the Pursuer were to stop (Sy = 0), the Evader would 
escape in the shortest length of time by steering a course 
directly away from the Pursuer and would escape at point D. 
An eXamination of the distance and speed involved in this 
ieactilc duseneces the fact that the time requimedetemecea-c 
meom pOint B’ te DB 1s 2.5, which indicates that etnrs eure 
preferred by the Pursuer, who desires to maximize the time 
until the Evader escapes. That is to say that although the 
entire curve BB'B" describes an escape route, only that 
portion from B to B' lies on the optimal path. Extending 
this results in the conclusion that: all optimal escape paths 
which intersect the radius OD utilize that portion of OD 
from the point of intersection to point D. Those portions 
Seethe curves lying in the fourth quadrant, while constituting 
escape paths, are not optimal. 

Similarly, those curves which intersect the vertical 
radius OE before reaching the horizontal diameter D'D are also 
meermal only in the first quadrant. For example, curve CC’ € 
describes an escape path, but the time to escape, T, follow- 
ing the curve C'C" is 1.4 while that for the line segment 
fee, 1S 3./1. At point C' the optimal tactic for the Puxrsuer 
1s to steer directly toward the Evader (¢ = 0) and stop when 
the: Evader is at point 0. This will cause the time required 
to escape from point C' to be as noted above (3.71). 

AS pointed out by Taylor, for u = U = 60 degrees, the 
meth does form a cusp. This cusp occurs at time tT = 1.4 at 


eernt A*° on Figure 1. That part of the curve for values ce: 


Jd 








T greater than 1.4 is mot optimal, tor an Evaderecmeeies 
portion of the curve could escapemmore quicklivea Sicilia via. 
a path which would lead him to escape the detection region 
ee some escape angle greater tEhanwso0 degrecs seiner sean mem 
mae curve for u = 60 degrees for values of 1 Tess Ehanel 4 
(arc AA') is indeed the barrier, for those segments of the 
escape paths (for escape angles greater than 60 degrees) to 
the right of the barrier are likewise not optimal in that an 
Evader could escape the detection region sooner by following 
Emeath roughly parallel to A‘A. 

This termination of the barrier at point A‘ is the 
criteria which indicates that no surveillance zone exists. 
Meesuch a zone did in fact exist, the barrier would be the 
boundary of a closed set of points which would not lie on any 
escape path. As can be seen from the mapping of paths on 


Figure 1, such a set of points does not exist. 


B. ADEQUACY OF THE MODEL 

In examining the requirement of the model that the 
Pursuer stop (S4 = 0) at the time that the Evader reaches a 
point 90 degrees or 270 degrees relative to the Pursuer's 
heaging, 1t was discovered that a clarification of equation 
(D8) of Appendix D of [1] was required. The equation is 


repeated here. 


NIA 


Tr 
Wy 1e@as my <ee< 
S, (t) = 
QO for 


Nie 


a2 








It would appear that this equation states thatyat ytnewecea.— 
angle will be greater than 90 degrees the Pursuer should stop. 
This is incorrect as the value of Sy iS not a £unCciiemscr ue 
the escape angle, but rather is a function of time and the 
mosition of the Evader on the escape path. Since 7 — ieee 
pws further a function of 1. The equation and Condi esone 


iL 


for its equality are correctly stated as 


Wy form: suck that spe wo 


Sy) = . 
O otherwise. 

The values of the parameters used were considered appro- 
priate for a destroyer-submarine surveillance situation, 
considering conventional submarines and the sonar equipment 
most commonly in use in the present-day fleet. For the newer 
sonar equipments the ratio of sonar range to minimum turning 
radius of the destroyer would be low, however, but it is felt 
fate this does not significantly detract from the result of 
this study. 

One aspect of the operational situation which is not 
covered by the model examined is the reacquisition of the 
Evader after it has escaped from the detection region of the 
Pursuer. This is an important aspect, for surveillance of 
potentially Mestale Submarinewscontacts Calls for extended 
periods of surveillance, and while this model maximizes the 
time which is required for the Evader to escape the detection 


megvon, it 1S a “single pass" model. 


urs 








C. REACQUIRING EVADER AFTER ESCAPE 

A model which would be more applicable to a continuous 
surveillance-evasion situation would be one which would take 
under consideration the fact that, Since no surveillance 
zone exists, the Evader will eventually escape the detection 
region and must be reacquired for long-term surveillance to 
be possible. 

Such a model should have as its objective the minimization 
of reacquisition time; that is, it should minimize the time 
during which the Evader is not in the detection region of the 
merSuer. 

The tactics utilized by the Pursuer to place the Evader 
back in his detection region after escape haS occurred would 
depend on several factors, but primarily they would depend 
on the position of the Evader at the time of escape and the 
Peoumptions concerning perfect or imperfect information. 

Concerning the latter, the assumption of imperfect infor- 
mation once eScape has occurred would be valid from the 
viewpoint of the Pursuer, Since the Evader is no longer within 
the detection region of the Pursuer, but would be less valid 
from the point of view of the Evader if one is considering a 
destroyer-submarine situation. This is true because of the 
much longer range capability of the passive detection devices 
in use aboard submarine type vessels as compared to the 
active ranging devices commonly in use aboard the destroyer 


type ships. 
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Conversely, the assumption of perfect information once 
escape has occurred is invalid from the point of view of the 
Pursuer (the Evader is no longer in the detection region of 
the Pursuer) but is more valid when considering the Evader, 
for the same reason mentioned above. 

Therefore, the more realistic approach would be to assume 
perfect information to the Evader on the movements of the 
Pursuer, but imperfect information to the Pursuer on the 
movement of the Evader. 

A further assumption of instantaneous acceleration and 
deceleration for both Pursuer and Evader, while not completely 
realistic, 1S in order and it is felt that this would have 
little or no effect on the accuracy of the models. 

It has been noted that, given optimal manuevering by both 
Pursuer and Evader, escape will occur at a point on the 
boundary of the detection region at an escape angle u, such 


that (for the particular parameters used in this study) 


90° > u > 60° 


for those escape paths which do not intersect the vertical 
axis of the detection region (radius OE in Figure 1) and at 
u = 180 degrees for those paths which do intersect the vertical 
eo S.. 

Consider the possible actions for the Pursuer at the time 
of escape in the first case. One such action would be to 
continue in a turn (¢ = +l) at maximum speed (sy = Wy) in 


which case the Pursuer's trajectory would be as described by 


15 








the arc AA' in Figure 2. Denote the time required for the 
Pursuer to travel the arcllengtheirom isto Als cee een 
instant the Pursuer arrives at point A', the Evader must be 
within a circle of radius Z centered at point B, point B 
representing the point at which the Evader escaped from the 


mietection region, where Z = wait. The probability tha ene 


2 
Pursuer 1S again maintaining surveillance of the Evader when 
at point A‘ is represented by the ratio of the area of the 
intersection of the circles centered on A' and B to the area 
of the circle of radius Z centered on point B. If the Evader 
is within the detection region at this time, the escape paths 
of Figure 1 can be used to again effect an escape. 

A second possible course of action would be to manuever 

as indicated in Figure 3. In this case, the initial action 
at the time of escape would be a turn to the left (¢ = -l) at 
point A, with a subsequent turn to the right at point A' 
(6 = +1) to traverse an arc A'B which would place the Pursuer 
at point B, the last known position of the Evader, at time t. 
Again, due to the speed restriction on the Evader, the Evader 
will be within a circle of radius Z centered at point B, 


where again Z = wot. The probability that the Evader is under 


2 
Surveillance at time t is again represented by the ratio of 
the’ area of possibility of the Evader which is enclosed in the 


detection region of the Pursuer to total area of possibility 


of the Evader. 
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For the case of escape from Ene detections reac ana 
degrees, it is proposed that a turn to the right at the time 


of escape (¢ = +1) at maximum speed (sy = Ww be made by the 


1? 
Pursuer at point A in Figure 4. This turn would be maintained 
amit 1. 1 ae Pursuer arrived at point A’, which 1s thespomtsen 
mangency with the turning circle of a tangent through) the 

last known position of the Evader, point B. AS can be deter- 
Mined by examination of the radius of possibility of the 
Evader, the probability that the Evader is within the detection 
region when the Pursuer arrives at point B is quite low. 

It should be noted that the optimal values of T aS Seen on 
Figure 1 indicate that the surveillance time on each pass of 
the "single pass" model examined is greater for those points 
on the detection circle near the heading of the Pursuer than 
HomeepOlnts at larger angles from the Pursuer’s heading. There= 
fore, it would appear that it would be advantageous to attempt 
fo Manuever the Pursuer to enable him to reacquire the Evader 
at a point as near as possible to the Pursuer's heading. 

This would appear to be possible as the assumption of perfect 
information on the part of the Evader would permit one to 
predict the Evader's movements during the time he is out of 


the detection region of the Pursuer. 
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IV. jsCONCEUS TONS 


As a model to describe a surveillance-evasion situation, 
the differential game model examined proved to realistically 
describe a situation which would confront a destroyer 
attempting to maintain surveillance over a potentially 
hostile submarine contact. However, the model fails to pro- 
vide for a long term surveillance situation which is currently 
required to be met by the operating forces at sea. 

In the case whereby the Evader can escape the detection 
meqgion, the current model must be modified to provide for 
faearequisition after the escape or it must be used in con= 
wemecion with some existing purSuit-evasion model. Ihe 
Sage stions provided in this paper hopefully will provide 
insight into the problems surrounding reacquisition and a 


Peres for further research effort in this vital area. 
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Figure 1. Escape Paths. Figures denote time 
until escape. 











Figure 2. Manuever for Reacquisition for 90 
degree escape angle. 
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Figure 3. Alternate Manuever--90 degree escape 
angle. 
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Manuever for Reacquisition for 180 
degree escape angle. 


Figure 4. 
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